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Exploring learners’ perceptions of the use 
of digital letter games for language 
learning: the case of Magic Word 
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Abstract. In this paper, we present two versions of a learning game developed 
respectively at the Grenoble Alpes and Bologna University. This research focuses 
on a digital game aimed at favouring the learners ’playful attitude and harnessing 
it towards accuracy aspects of language learning (lexicon and morphology, here). 
The game, presently available for English, French and Italian, could be described 
as a letter game stemming from the archetypal example of Turoff ’s Boggle. Avatars 
of this game genre both exist as commercial off the shelf games and as learning 
games. We explain in this paper how our two versions respectively tackle two 
different aspects of language learning. We conducted an experiment in which all 
students tried both versions to study their perceptions of both games contrastively 
in order to prepare for the development of subsequent versions of the game. 
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1. Game based (accuracy) learning 9 

Many researchers see various advantages in game based learning (e.g. Oblinger, 
2004). Some see games as consistent with the central notion of tasks (Cornillie, 
Thorne, & Desmet, 2012). Yet the emergence of a playful attitude, considered 
productive in games in terms of (language) learning (Silva, 2008), is far from being 
systematic in learning games. In the hope of favouring its emergence, we resort to 
the metaludic rules (pertaining to a game genre) (Silva, 1999) of successful and 
repeatable games (digital or board games, which do not rely on a plot). 

Our research could be described as ‘design based’, which is inseparable from 
iterative development (Harvey & Loiselle, 2009). To prepare for subsequent 
iterations, we implemented two versions of the same game with a view to comparing 
the responses of learners to both. Each version has its own pedagogical approach 
but both address accuracy - micro-operations and language correction - as opposed 
to fluency (Portine, 2013). The first prototype was conceived and implemented at 
the Grenoble Alpes University (Loiseau, Zampa, & Rebourgeon, 2015), within the 
Innovalangues project (Masperi & Quintin, 2014), while the second was developed 
by the University of Bologna within the context of the ‘E-LOCAL for all’ project 
(Ceccherelli & Valva, 2016). 


2. The prototypes 

Despite adopting different points of view, both versions of our digital letter game, 
called Magic Word, are based on the same metaludic rules that could be exemplified 
by the well-known example of Boggle 10 , where the user is presented with a 4x4 
letter grid and can create inflected forms (‘example’ and ‘examples’ are considered 
two separate words) using contiguous letters, in every direction, using each letter 
cell at most once per word form. 

The Grenoble prototype was implemented in 2014 * 11 . Available in French, English 
and Italian, it aims at harnessing normative rules - rules adopted by advanced 
players of the game (Silva, 1999) - to work on morphological aspects of the 
language. It is inherent to the game, especially for languages with rich inflexion 
mechanisms, that the player should exhaustively seek all forms stemming from 


9. Our approach is consistent across projects, this re-uses parts of Loiseau, Hallal, Ballot, and Gazidedja (2016, this volume) 
rather than artificially paraphrasing it, but also completes it. 

10. Designed by Turoff in 1972, see https://en.wikipedia.org/wiki/Boggle. 

11. http://gamer.innovalangues.net/magicword/ / https://github.com/InnovaLangues/Magic-Word-game 
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found words (Loiseau et al., 2015). In Figure 1, for instance, if both players found 
‘ mia ’ (‘my’, fem. sing.), the player who realises that its masculine (‘ mio ’) and 
plural feminine (‘ mie ’) forms are also in the grid will have an advantage over the 
opponent. Even if a player finds a form by luck, the competitive nature of this 
version provides an incentive to infer the category of the word in order to see if the 
grid does not contain other forms. Games are played one-on-one (asynchronously) 
in three sets. While the lexical nature of the game is mainly addressed through the 
existence of a personal lexicon for each learner, called a ‘wordbox’, stemming 
mechanisms are at the core of the rules. 


Figure 1. Screen captures of both versions of the game (left: Grenoble / right: 
Bologna) 



The Bologna prototype 12 , solely in Italian, is to be interfaced with the ‘E-LOCAL 
for all’ project. Dedicated to helping student mobility and multilingualism, the 
project proposes eight core units built around a main theme linked to a possible 
real-life situation (Ceccherelli & Valva, 2016). This thematic progression calls for 
a focus on vocabulary that the Grenoble version coidd not provide. Creating grids 
containing certain forms is a complex algorithmic problem. This version provides 
a solution able to produce a grid containing a significant number of E-LOCAL 
terms (Roccetti et al., 2016). Each grid in this prototype has a specific cultural 
background concerning Italy and specifically Bologna; graphics were adapted 
through pictures linked to each theme to convey that cultural focus. 


3. Experiment protocol 

Following design based research principles, we took advantage of these two 
versions to gather learner reactions to each prototype’s specificities: different 


12. http://www.lilec-linguistica.it/magicword/page.html / https://github.com/giacomo-mambelli/magicword 
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learning objectives (morphology vs lexicon) sought after through different game 
structures (speed and competition vs completion of lexical puzzles), with different 
input modalities (sliding vs successive clicks) and layouts. 

The experiment was conducted for Italian as a foreign language over 20 groups of 
learners from the Universite Grenoble Alpes and the Universita di Bologna (group 
levels Al to Cl). It took place in March and April 2016 during the classes of eight 
different teachers. The project and games were introduced briefly. Around 40 minutes 
were then left to the 148 learners 13 surveyed to test both games and 20 minutes to 
fill out the questionnaires presented to them (in English, French or Italian). To make 
sure that results were not influenced by which game was presented first, some groups 
started with the Bologna version while others with Grenoble’s. A third of the students 
(59) were given a self-assessing pre-test. Students were to tick the words they knew 
from a list. It meant to get an indication of their lexical knowledge, but also to see 
whether reading some words present in the Bologna grids before playing would help 
them solve the puzzles. Such short exposure to the games will not allow us to draw 
any conclusions concerning their learning outcomes (Girard, Ecalle, & Magnan, 
2013); we focused on the students’ reactions and expectations. 


4. Results 

We are interested in the learners’ perceptions of the game and their inclination to 
play them again. After the experiment, we asked them whether they woidd like 
to play (any) Magic Word during their Italian language class, nearly 85% of the 
students answered positively. 

The students were also asked to answer on a four-level Likert scale various 
questions, including concerning their appreciation of the games (how much fun 
they had playing and whether they would like to play again) and if they felt they 
could learn while playing them. Considering the two upper levels of the Likert 
scale as positive outcomes, about 80% of the students found the Bologna version 
fun and more than 75% wanted to play it again, while more than 85% found the 
Grenoble version fun and 85% wanted to play it again. 

Attributing a number (one to four) to every level of the scale allowed to perform 
inferential statistics 14 . The following results always use such data with questions 


13. 75% female, 90+% between 18 & 24 years old. 

14. The tests performed were paired samples t-tests, Welch two samples t-tests, Pearson’s Chi-squared test with Yates’ continuity 
correction and Pearson’s product-moment correlation (Norman, 2010). 
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directly targeting each feature described. For instance, the differences above were 
significant (Fun: f(147)=-4.3533, p<. 001; Play again: f(147)=-3.5961, jrK.001), 
even though the students significantly preferred the graphics of the Bologna version 
(92.5% favorable opinion for Bologna vs 83% for Grenoble - t{ 1 47)=3 .2286, 
/K.005). This difference could be linked to the fact that 93% viewed competition 
positively (Grenoble) against 79% appreciating being able to play without the 
pressure of a timer (Bologna). 

The learners found the Bologna version slightly, yet significantly, more relevant 
for learning than the Grenoble version (75% favorable opinion for Bologna vs 71% 
for Grenoble (t( \ 47)=2.5376, /;<.()5), thus echoing the teachers preference for the 
lexical dimension of the game. 

Finally, results to the pre-test did not yield effect on other variables, taking it did 
not influence the players’ achievements. Flowever, its mere presence underlined the 
importance of the Tudic context’; learners who were administered the tedious pre- 
test (checking long lists of words) showed less inclination towards playing either 
game again (Reusing MW in class: / 2 (1)=4.0281, /K.05; Play again - Grenoble: 
f(92.5)=2.9759, /K.005; Play again - Bologna: f(102)=1.7607,/X.05). 


5. Discussion, future works and conclusion 

Our experiment, testing two versions of Magic Word, shows positive reception of 
both versions in terms of game characteristics and expected learning outcomes. 
Though the fact that the games were played for less than an hour should be taken 
into consideration when interpreting the results, this reception is encouraging. 
Learners display a certain preference for the Grenoble version, though the Bologna 
version is perceived as more likely to result in learning. We also know its rules are 
more favoured by teachers, which could be linked to the level of rules at which 
the ‘learning’ component is integrated (constitutive or even metaludic for lexicon 
vs normative for morphology). Thus, future versions of the game should (1) adapt 
the Bologna rules to introduce a competition element, and (2) make the normative 
rules of the Grenoble version more perceivable by beginner players. 

Consequently, the algorithm conceived in Bologna is of the utmost importance 
for both institutions as it will facilitate the integration of the game in classes. 
Completing these results, a focus groups showed that teachers are more prone 
to using Magic Word for lexical acquisition. The algorithm thus opens doors for 
customisation of the content by teachers, one of their central needs (Hallal, 2015). 
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Thanks to the open-source nature of both prototypes, a new version is being 
implemented in Grenoble. Though this work is mostly focused on the ludic structures, 
the response of the students who took the pre-test also underlines the influence of the 
ludic context on the reception of the game, highlighting Silva’s (2008) point of view. 
Finally, it is worth mentioning that neither the proficiency level of the students, 
nor their gaming experience or gender yielded any significant difference in their 
appreciation of either game. 
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